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Abstract. Statistical evidence of the influence of neighborhood topol- 
ogy on the performance of particle swarm optimization (PSO) algorithms 
has been shown in many works. However, little has been done about 
the implications could have the percolation threshold in determining the 
topology of this neighborhood. This work addresses this problem for in- 
dividuals that, like robots, are able to sense in a limited neighborhood 
around them. Based on the concept of percolation threshold, and more 
precisely, the disk percolation model in 2D, we show that better results 
are obtained for low values of radius, when individuals occasionally ask 
others their best visited positions, with the consequent decrease of com- 
putational complexity. On the other hand, since percolation threshold 
is a universal measure, it could have a great interest to compare the 
performance of different hybrid PSO algorithms. 
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1 Introduction 

Percolation theory appears in very different random structures, including spread 
of diseases, fire propagation in forests, phase transition in solids, diffusion in 
disordered media, etc. There are number of good reviews of the percolation the- 
ory |10lll| . This theory is particularly well adapted to describe global physical 
properties, such as the connectivity and conductivity behaviour of geometrically 
complex systems. This work analyzes the role of percolation threshold, a uni- 
versal measure of connectivity in graphs, to analyze the convergence of swarms 
algorithms as a function of the expected number of neighbors at initial step. And 
therefore, to develop a framework to compare the performance of hybrid PSO 
algorithms. The analysis of the performance of different hybrid PSO algorithms 
has been addressed in different works |4|7l3j . However, in this work, we focus 
on the concept of percolation threshold as a useful tool to define the parameter 
space for which the performance of the basic PSO algorithm is enhanced. 

The basic model of PSO by Eberhart, Kennedy and Shi |8l6j is an stochastic 
optimization method for _D-dimensional functions. Given a population of P in- 
dividuals i, 1 < i < -P, uniformly distributed on an D-dimensional hypercube of 



size S in points Xi — {xn, . . . , Xid, ■ • • , Xio), each individual moves to next po- 
sition according to a velocity vector Vi = {vn, . . . , Vid, ■ ■ ■ , Wjd) both calculated 
according to ([1]): 

Vid = ™ * Vid + ci * rand (1.0) * (p^d - ai^id) + C2 * Rand (1.0) * (pg^d - Xid) 

Xid = Xid + Vi 

where values rand{l.()) and Rand{\.()) are drawn at random according to a 
uniform distribution in the interval [0,1]. Velocity Vi{t + \) is a randomized 
linear combination of three forces: (i) inertia, weighted by parameter w £ [0, 1], 
{a) the personal attraction ci to the position pi where the minimum value of a 
function / {pi) was found, and {in) the social attraction to the position pg. of 
the best goal remembered by the neighbors of individual i in a given topology. 

In many works, the neighborhood of each individual includes the whole pop- 
ulation and the best goal Pg — Pg. is visible for all the agents in a blackboard 
architecture. In these cases, the gain in efficiency runs in parallel to the lose of 
autonomy of agents in the model. For realistic purposes, as in swarm robotics, 
the notion of Euclidean neighborhood is a building block since sensors and effec- 
tors have physical limits. Some authors [12114) have carried out social network 
statistical studies to address the effects of neighborhood topology in PSO algo- 
rithms, concluding that the topology used conditions strongly the convergence 
of these algorithms. 

In this work, based on the so called continuum or disk percolation model [1] , 
we investigate the effect of the percolation threshold according to the topology 
of geometric graphs. A geometric graph is a 2D representation of a graph: given 
a neighborhood radius R and a square board of size S, let {xi, . . . ,xp} be the 
initial positions of individuals composing the swarm selected at random following 
a uniform distribution. The geometric graph is built connecting each node to all 
neighboring nodes in radius R. Percolation disk theory allows the calculus of the 
radius R, that ensures a mean of a neighbors per node (called the area or degree) 
with parameters of population of P individuals and world size S, according to 



We study experimentally the convergence of PSO algorithms focusing on 
the concept of percolation. The percolation concept comes from chemistry and 
refers to the way a liquid flows through a porous medium, like a large piece of 
pumice stone and sets what is the probability that the center of the stone is 
wet when we immerse it in water. Other example is making coffee: if ground 
coffee is fine grained, under a determined threshold for the diameter of grain, 
water stagnates, while over this threshold water falls through coffee. In terms 
of random graphs, percolation is identified to the phenomenon of passing from 
numerous small connected components to a connected one as a function of the 
number of expected neighbors a. The critical value of a receives the name of 
percolation threshold Qc- 




(2) 



Fig. 1. Random geometric graphs with parameters a) a = 0.8, R = 18.426, b) o = 
4.512, R = 43.760, c) a = 29, i? = 110.941 



Percolation is a complex phenomenon which suggests that agents in a swarm 
only need a minimum of social information to perform the optimization task, 
being redundancy a source of futile complexity. It has been proved [1] with 
confidence 99.99% the following bound for the critical percolation threshold Uc 
and the corresponding critical value i?c, obtained as the average degree over the 
squares of any size S: 

4.508 < ac ~ 4.512 < 4.515 (3) 

43.741 < i?c ^ 43.758 < 43.775 (4) 

We will show experimentally that neighborhoods of critical radius Rc are 
enough to reach goals in a minimum number of steps. The following definitions 
and parameters were set in order to compare results with those of [2|5|13j . 

— Neighbors are determined by the euclidean distance d: let Xi be the position 
of individual i, Nfi (x^) = jx^j , . . . , Xi,^. } is the set of neighboring individuals 
in radius i?, that is d (xi, Xi-) < i?, 1 < j < . 

— The neighbors best value of function / known by agent i in its neighborhood 
is defined as: Pg. = minf {pi^ : Xi- G (x^)}, that is, the position pi- re- 
membered by neighbors (at current position Xi- ) minimizing goal function 
/. The social best of Xi is defined as the mean neighbors best value at final 

step, ^p"' . 

— Experimental parameters are exactly those given in [5]: a swarm of P = 30 
individuals and square side S = 200 and center (0,0). Velocity module \v\ = 
\/vf + V2 is limited by Xmax = Vmax = 100, meaning that individuals move 
a step forward in the direction of vector v with step length s{v) = Vmax if 
\v\ > Vmax and s{v) — \v\ otherwise. Clerc's [2] optimal parameters c\ = 
C2 — 1.49445 and constant constriction factor w = 0.729 where used. 

— Benchmark functions are those used in |5I13| . The model has been imple- 
mented in Netlogo 4.1, running in concurrent mode (individuals are updated 
once the run step ends) with a float precision of 16 decimals. An experiment 
consists in 100 runs for each function, 20 for each instance of parameter R. 



— We compare results for Clerc's parameters set |2|5] w = 0.729, ci = C2 = 
1.49445 and Trelea's parameters w — 0.6, ci — C2 — 0.7. Since disk percola- 
tion threshold is a 2D measure, the dimension will be D = 2 for the scope 
of this work. The domain of the benchmark functions will be Xmax = 100 = 
Vmaxi as well as the goal, 0.01 for all functions. In this way results concerning 
percolation threshold can be easily compared. 

2 Analysis of goals as a function of the expected degree 
at initial step. 

Applying equation ((2), we explore the success of PSO algorithm as a function 
of radius R{a) according to a longitudinal study of the mean degree expected at 
initial step. 

— Dataset A: 0.000 < a < 0.9, meaning that only a fraction of the individuals 
has neighbors: from 0.0 to 0.9 with step 0.1. Table[T]shows the corresponding 
neighborhood radius R{a). Each function is run 20 times, so for each R{a) 
100 runs were completed. 

— Dataset B: 1 < a < 30, from the minimum (1 neighbor) to the maximum 
(29 neighbors) plus one, 30 neighbors with step 1. Neighborhood radius R 
varies in the interval 20.601 <R< 112.838. 

— Best global value registers at each run step the best position remembered 
by any agent, that is best — global — val (t) = min {/ {pi (t)) 1 < i < P}, 
updated every time that an individual finds a smaller value Xi (t + 1) < 
best — global — val {t). 

— Mean best neighbors value is the average social information over all the 
individuals, best — neighbors — vali (t) — min{f (pj (t)) : }, updated every 
time that an individual finds a smaller value Xi {t + 1) < best— global— val (t). 

Varying the benchmark function and the radius of neighborhood as parameters, 
each pair 20 runs, with goal precision 0.01 and a maximum number of iterations 

— 900, results in table [21 Even including the case of neighborhood radius 
i? = 0, the performance of the PSO algorithm does better for graphs with 
initial mean degree < a < 0.9: with the only exception of /i the mean best 
global values are successful reaching the goal 0.01. As was expected, the objective 
function has to do in the performance of the algorithm: it is harder to optimize 
function /i, but never ceases to amaze that respecting to the social force, less 
neighbors means better performance of PSO. In a further section we will analyze 
accurately the performance of the algorithm for values a = and < a < 0.9. 
The mean iterations (over a maximum of — 900) averaged over all runs is 
similar for datasets A and B. 

Figure [2] shows mean values of the best global as a function of neighborhood 
radius R (a) calculated according to ([2]). As it can be appreciated, the best result 
corresponds to a disk radius R (a) = 6.515 where the degree a = 0.100 is the first 
one being explored. This means that initial configurations, where 10% of individ- 
uals have a neighbor, give the best performance. Note that a < log (log (P j) = 



a 


0.000 


0.100 


0.200 


0.300 


0.400 


0.500 


0.600 


0.700 


0.800 


0.900 


R 


0.000 


6.515 


9.213 


11.284 


13.029 


14.567 


15.958 


17.236 


18.426 


19.544 



Table 1. Values of neighborhood's radius R{a) as a function of expected degree a. 



Function 


Goals 


Best global 


Steps 


A 


B 


A 


B 


A goal 


B goal 


A all 


B all 


Spherical /o 


95.50% 


100.00% 


0.01 


0.00 


92 


56 


129 


56 


Roscnbrock /i 


52.00% 


9.00% 


0.09 


0.06 


588 


370 


738 


852 


Rastrigin /2 


95.00% 


100.00% 


0.01 


0.00 


82 


58 


123 


58 


Giiewank fs 


100.00% 


100.00% 


0.00 


0.00 


2 


2 


2 


2 


Schaffcr fe 


100.00% 


100.00% 


0.00 


0.00 


5 


4 


5 


4 


Total 


88.50% 


81.80% 


0.02 


0.02 


108 


38 


199 


195 



Table 2. Percentage of goals, average best global value and iterations over all runs for 
datasets A, < a < 0.9, 0< R< 19.544 and B, 1 < a < 30, 20.601 < R< 112.838.. 



0.169 since P = 30 and hence each run has computational complexity at most 
of the order of Plog (log (P)). Over the critical radius Rc the mean global best 
stops increasing to become constant. As one might expect, Fig. [5] shows that the 



Mean global best. All runs. 




Fig. 2. Mean global best as a function of neighborhood radius R shows that PSO be- 
haves better under critical Rc — 43, 758. Non successful runs are included. A minimum 
is obtained at R=6.515 growing until Rc is reached. 



only memory of the best personal value gives comparatively a poor score. Even 
so, this score is over the 60%. The importance of social information is crucial: 
surprisingly the smallest number of initial neighbors gives the majority of the 
goals. Near of the percolation threshold Rc — 43, 758 the score starts remain- 
ing constant. Finally, the mean iterations needed for success, with a limit of 
P^ = 900, reach the minimum at i? = 6.515. From this value, the mean over all 
the runs slightly increases becoming constant, near to 195 steps, for values upper 
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Fig. 3. Number of goals reached as neighborhood R increases. 



to Rc — 43.758. On the other hand, the average over successful runs decreases 
until the threshold Rc is passed reaching a constant value near in mean to 36 
steps. 
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Fig. 4. Mean number of iterations. Square marks represent the mean over all runs and 
diamonds over successful runs. 



The mean value of social best, that is the average value of the best personal 
value of neighbors, was measured at final step. The mean over all runs is pre- 
sented in Fig. O Beyond value R = 61.804 the mean reaches value rounded 
to 3 decimals. This occurs because some individuals fly outside the limits of the 
board having neighbors. This curve, as will be shown in next section, seems to 
be very sensible to the variations of R, decreasing drastically at critical radius 
Rc. 
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Fig. 5. The mean of social best at final step. 



3 Exploring the disk percolation threshold 

Values of R around critical radius Rc were finely explored varying degree a along 
the interval [4.37,4.515] just before the critical threshold Oc = 4.512 with step 
0.001. Hence R{a) varies in the interval [43.066, 43.775] in intervals of 0.01. Each 
instance of parameter R was run 100 times, 20 for each function fi. Table|3]shows 
the means of goals, the best global value reached and final step. Comparing to 
table[2l the total of successful runs equals the goals of dataset A, 88.5%, as well as 
the mean best global value, 0.02. The difference with dataset A is in the number 
of steps: at critical radius Rc the performance of PSO algorithm decreases to 
mean of 42 iterations in successful runs, near to the 38 steps reached in dataset 
B. Mean steps, 197, are just in the middle of the 199 obtained for dataset A and 
the 195 of dataset B. As a conclusion, the performance of PSO algorithm with 
flc between 4 and 5 neighbors is the same as with large values, even when the 
neighborhood comprises all agents. 

In closing, the curves of mean social and personal values are represented in 
Fig. |3] together with the global best value and the percentage of goals. Pearson 
correlations were calculated between all the series being the most significant the 
negative correlation between goals and global best, -0.385. We conjecture that 
the lack of correlation between variables is a characteristic of the interval around 
the critical radius. 



4 Exploring R in the the interval [0, 0.9] 

As it has been reported in Fig. [5] the minimum value of global best occurs at 
a = 0.1, R{a) = 6.515. For the same radius, the Fig. [2] shows a maximum of 
successful runs. This suggest that PSO does better with less, but some, social 





Goals reached. 


Best global all. 


Steps Goals 


Steps all 


Spherical /o 


95.50% 


0.01 


57 


57 


Roscnbrock /i 


52.00% 


0.09 


509 


861 


Rastrigin /2 


95.00% 


0.01 


60 


60 


Gricwack fs 


100.00% 


0.00 


2 


2 


Schaffcr fe 


100.00% 


0.00 


4 


4 


Total 


88.50% 


0.02 


42 


197 



Table 3. Percentage of goals and mean best global values. With the only exception of 
/i the mean best global values are successful reaching the goal 0.01. 




Fig. 6. Values just before Rc — 43, 758: Social and personal information show a great 
variability, while goals and global best vary slightly. 



contact: degree a — 0.1 means that only one in ten individuals has one neighbor 
at initial step. The interval R e [0, 0.9] , or equivalently a G [0, 0.001909] was 
explored to investigate the pass of having no neighbors to have a minimum 
of social contact. A total of 91 instances of R with 20 runs per function were 
executed. Table |4] shows surprising results: the 94.13% of the runs were successful 
in the interval [0.75, 0.9] with the only handicap of longer iterations, reaching a 
mean of 258 steps. 



function 


Goals 


Stops all 


0.0-0.25 


0.26-0.50 


0.51-0.75 


0.75-0. 90 


0.75-0.90 


Spherical /o 


60.58% 


91.20% 


99.60% 


100.00% 


262 


Roscnbrock /i 


2.88% 


19.80% 


50.60% 


70. 67% 


750 


Rastrigin /2 


60.19% 


90.00% 


99.80% 


100.00% 


265 


Gricwank /a 


100.00% 


100.00% 


100.00% 


100.00% 


3 


ScliafFcr /g 


100.00% 


100.00% 


100.00% 


100.00% 


9 


Total 


64.73% 


80.20% 


90.00% 


94.13% 


258 



Table 4. Exploration oi R £ [0, 0.9] subdivided in intervals: 



Figure |4] shows that high values of social information are related to increasing 
goals and decreasing global values. To corroborate this tendency, the Pearson 
coefhcient of correlation was calculated in table [5] A very significant positive 
correlation exists between the percentage of goals with R and the mean social 
best: the major the dispersion of neighbors the major the goals. Conversely, the 
goals go in a very significant negative correlation with global best: the less the 
best global value the more the goals . The mean best global value decreases as 
radius R and social best increase. 



Correlation 


R 


Social best 


Personal best 


Global best 


Goals 


Steps 


R 


1 












Social best 


0.591 


1 










Personal best 


-0.122 


0.024 


1 








Global best 


-0.908 


-0.712 


0.049 


1 






Goals 


0.956 


0.720 


-0.058 


-0.947 


1 




Steps 


-0.96 


-0.668 


0.042 


0.915 


-0.967 


1 



Table 5. Pearson coefficients of correlation for dataset R G [0, 0.9]. 



5 Comparing different domain through degree a. 

Experiments in previous sections were made over the same domain conditions of 
fo and fe- Xmax = 100, S = 200. Disk percolation theory gives us a way to relate 
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Fig. 7. Comparison of mean goals and tlie mean social, personal and global best for 
small values of R £ [0, 0.9]. The minimal contact with neighbors, for radius over 
R = 0.6 ensures the convergence. 



the expected number of neighbors a to neighborhood radius R of individuals in 
spite of different values of parameters of the world, population P and square 
side 5, were supplied. In table |6] we report values of R for different degree values 
oi = 0.00151, a2 — 0.8, as = 29 and at a critical radius Oc = 4.512, calculated 
according to ([2]). Table [6] shows that conditions Xmax = 100 = and P = 30 
give for each a a corresponding radius R (a) in the intervals studied in previous 
sections: i?(0.00151) = 0.8 e [0.75, 0.9] analyzed in sectionH i?(0.8) = 18.426 in 
dataset A and i?(29) — 110.941 in dataset B of section [2] and the critical radius 
Rc = R (cc) in section [3l We wonder if a change of parameters values will report 
different patterns of PSO convergence. 





ac 


S 


P 


Rc 


fo 


0.00151 


200 


30 


0.801 


h 


0.00151 


60 


30 


0.240 


h 


0.00151 


10.24 


30 


0.041 


h 


0.00151 


1200 


30 


4.803 


h 


0.00151 


200 


30 


0.801 


h 


4.512 


200 


30 


43.760 


h 


4.512 


60 


30 


13.128 


h 


4.512 


10.24 


30 


2.241 


h 


4.512 


1200 


30 


262.561 


h 


4.512 


200 


30 


43.760 



,/ 




S 


P 


Rc 


.fo 


0.800 


200 


30 


18.426 


/i 


0.800 


60 


30 


5.528 


.f2 


0.800 


10.24 


30 


0.943 


h 


0.800 


1200 


30 


110.558 


h 


0.800 


200 


30 


18.426 


fo 


29 


200 


30 


110.941 


/i 


29 


60 


30 


33.282 


/2 


29 


10.24 


30 


5.680 


/3 


29 


1200 


30 


665.648 


fe 


29 


200 


30 


110.941 



Table 6. Radius values computed for each of the benchmark functions for different 
values of a. 



For each value of parameter a the experiment was repeated 500 times, 100 
for each function fi. All the runs converged with the goal precision given in 
|5I13| . Hence, the only variable to compare is the mean number of steps, given 
in Fig. [S] The same pattern of convergence appears: at small values of a < 
R{a) G [0.75, 0.9] all the experiments converge, but more steps are needed. 
From the percolation threshold, a universal measure, the number of steps slightly 
decreases. 
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Fig. 8. Mean steps with Trelea's parameters w = 0.6, ci = C2 = 0.7. 



6 Conclusions 

We show in this work that percolation threshold is a tool to analyze the conver- 
gence of swarms as a function of the expected number of neighbors at initial step. 
While traditionally PSO algorithm is based on the external calculus of the global 
best goal by reasons of convergence, we present here experiments suggesting that, 
for one hand, very small amounts of information, translated to very low values 
of a are enough to provoke the convergence of PSO swarms. Moreover, better 
scores of convergence are found. On the other hand, a low degree Oc = 4.512 
is enough to both purposes: convergence to the minimum and short runs. The 
steps needed for convergence become constant from this critical value. Hence, 
more neighbors do the same than Oc neighbors. Disk percolation threshold is a 
measure for 2D systems. Efforts will be made in investigating the calculus of 
percolation thresholds for higher dimension. An idea to do that is to compare 
the area of the circle of radius R to the surface of the square ttR'^/S^ looking 
for the value of radius R' such that a D-dimensional hypersphere of this radius 
maintain the same proportion with respect to the volume of the hyperboard. 

This work can be extended in a further development, comparing previous 
hybrid PSO approaches and using more benchmark functions. Moreover, we 
think it is of great interest to study the implications of percolation threshold in 
fuzzy neurocomputing areas |9] , since percolation is considered as a second order 
state transition phenomenon, having hence a crisp nature. 
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